Later in the film, Jafar has the Genie move the palace to a nearby mountain overlooking the city (as he wanted to "rule on high"), though it is restored to its original location at the end of the film.
The Sultan's palace during Jafar's reign